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Module 2: Data Analytics Lifecycle 


Continue 


Upon completion of this module, you should be able to: 

• Apply the Data Analytics Lifecycle to a case study scenario 

• Frame a business problem as an analytics problem 

• Identify the four main deliverables in an analytics project 
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Data Analytics Lifecycle 
Phase 2: Data Preparation 

Of all of the phases, the step of Data Preparation is generally the 
most iterative and time intensive 

* Prepare Analytic Sandbox 

► Work space for the analytic team 

► 10x+ vs. EDW 

• Perform ELT 

► Determine needed transformations 

► Assess data quality and structuring 

► Derive statistically useful measures 

► Determine and establish data connections 
for raw data 

► Execute Big ELT and/or Big ETL 


• Useful Tools for this phase: 

• For Data Transformation & Cleansing : SQL, Hadoop, MapReduce, Alpine Miner 
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enough good 
quality data to 
start building 
the model? 


Data Analytics Lifecycle 
Phase 2: Data Preparation 

9 Familiarize yourself with the data thoroughly 

► List your data sources 

► What's needed vs. what's available 
9 Data Conditioning 

► Clean and normalize data 

► Discern what you keep vs. what you discard 
9 Survey & Visualize 

► Overview, zoom & filter, details-on-demand 

► Descriptive Statistics 

► Data Quality 

• Useful Tools for this phase: 

• Descriptive Statistics on candidate variables for diagnostics & quality 

• Visualization: R (base package, ggplot and lattice), GnuPlot, Ggobi/Rggobi, Spotfire, 
Tableau 
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Do I have 
enough good 



Data Analytics Lifecycle 
Phase 3: Model Planning 





• Determine Methods 

► Select methods based on hypotheses, data 
structure and volume 

► Ensure techniques and approach will meet 
business objectives 

• Techniques & Workflow 

► Candidate tests and sequence 

► Identify and document modeling 
assumptions 


Useful Tools for this phase : R/PostgresSQL, SQL 
Analytics, Alpine Miner, SAS/ACCESS, SPSS/OBDC 



Do I have a good idea 
about the type of model 
to try? Can I refine the 
analytic plan? 
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Data Analytics Lifecycle 
Phase 3: Model Planning 




* Data Exploration 

* Variable Selection 

► Inputs from stakeholders and domain 
experts 

► Capture essence of the predictors, leverage 
a technique for dimensionality reduction 

► Iterative testing to confirm the most 
significant variables 


Do I have enough 
information to draft an 
analytic plan and share for 
peer review? 





Data Prep 



Do I have 
enough good 
quality data to 
start building 
the model? 


Model Selection 

► Conversion to SQL or database language for 
best performance 

► Choose technique based on the end goal 


and the data format 


Do I have a good idea 
about the type of model 
to try? Can I refine the 
analytic plan? 
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Sample Research: Churn Prediction in Other Verticals 

Mini Case Study: | 
Chum Prediction for 
1 Yoyodyne Bank ) 

• After conducting research on churn prediction, you have identified many 
methods for analyzing customer churn across multiple verticals (those in 
bold are taught in this course) 


• At this point, a Data Scientist would assess the methods and select the best 
model for the situation 


Market Sector 

Analytic Techniques/Methods Used 

Wireless 

Telecom 

DMEL method (data mining by evolutionary learning) 

Retail Business 

Logistic regression, ARD (automatic 
relevance determination), decision tree 

Daily Grocery 

MLR (multiple linear regression), ARD, and decision tree 

Wireless 

Telecom 

Neural network, decision tree, hierarchical neurofuzzy systems, rule 
evolver 

Retail Banking 

Multiple regression 

Wireless 

Telecom 

— Lopyrigni iy zui4 tiviL Lorpo 

Logistic regression, neural network, decision tree 
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Data Analytics Lifecycle 
Phase 4: Model Building 


* Develop data sets for testing, training, and production purposes 

► Need to ensure that the model data is sufficiently robust for the model 
and analytical techniques 

► Smaller, test sets for validating approach, training set for initial 
experiments 

9 Get the best environment you can for building models and 
workflows. ..fast hardware, parallel processing 



Is the model robust 
enough? Have we 
failed for sure? 


• Useful Tools for this phase : R, PL/R, SQL, Alpine Miner, SAS Enterprise Miner 
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Data Analytics Lifecycle 
Phase 5: Communicate Results 


Communicate 

Results 


I 


Mini Case Study: 

Chum Prediction for 
Yoyodyne Bank 


J 


Did we succeed? Did we fail? 

Interpret the results 

Compare to IH's from Phase 1 

Identify key findings 

Quantify business value 

Summarizing findings, depending on 
audience 


For the YoyoDyne Case Study, 
what would be some possible results and key findings? 
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Data Analytics Lifecycle 
Phase 6: Operationalize 


Do I have enough 
information to draft an 
analytic plan and share for 



Operationalize 


• Assess the benefits 





Is the model robust 
enough? Have we 
failed for sure? 


• Provide final deliverables 

• Implement the model in the 
production environment 

• Define process to update, retrain, 
and retire the model, as needed 


Model 

Building 




Do I have a good idea 
about the type of model 
to try? Can I refine the 
analytic plan? 
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Analytic Plan 

Mini Case Study: j m 

Chum Prediction for 

Retail Banking 

Components of 
Analytic Plan 

Retail Banking: Yoyodyne Bank 

Initial Hypotheses 

Transaction volume and type are key predictors of churn rates. 

Data 

5 months of customer account history. 

Phase 3: Model 

Planning - Analytic 
Technique 

Logistic regression to identify most influential factors predicting 
churn. 

Phase 5: 

Result & 

Key Findings 

Once customers stop using their accounts for gas and groceries, 
they will soon erode their accounts and churn. 

If customers use their debit card fewer than 5 times per month, 
they will leave the bank within 60 days. 

Business Impact 

If we can target customers who are high-risk for churn, we can 
reduce customer attrition by 25%. This would save $3 million in 
lost of customer revenue and avoid $1 .5 million in new customer 
acquisition costs each year. 
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Key Outputs from a Successful Analytic Project, by Role 


Role 

Description 

What the Role Needs in the Final 
Deliverables 

Business 

User 

Someone who benefits from the end results and can 
consult and advise project team on value of end results 
and how these will be operationalized 

• Sponsor Presentation addressing: 

• Are the results good for me? 

• What are the benefits of the findings? 

• What are the implications of this for me? 

Project 

Sponsor 

Person responsible for the genesis of the project, 
providing the impetus for the project and core business 
problem, generally provides the funding and will gauge 
the degree of value from the final outputs of the working 
team 

• Sponsor Presentation addressing: 

• What’s the business impact of doing this? 

• What are the risks? ROI? 

How can this be evangelized within the J 

uiydi iiz.dliui i (di id Leyui id)? 

Project 

Manager 

Ensure key milestones and objectives are met on time 
and at expected quality. 


Business 

Intelligence 

Analyst 

Business domain expertise with deep understanding of 
the data, KPIs, key metrics and business intelligence 
from a reporting perspective 

(• Show the analyst presentation > 

• Determine if the reports will change 

Data 

Engineer 

Deep technical skills to assist with tuning SQL queries 
for data management, extraction and support data 
ingest to analytic sandbox 

• Share the code from the analytical project 

• Create technical document on how to 
implement it. 

Database 

Administrator 

(DBA) 

Database Administrator who provisions and configures 
database environment to support the analytical needs of 
the working team 

• Share the code from the analytical project 

• Create technical document on how to 
implement it. 

Data Scientist 

Provide subject matter expertise for analytical 
techniques, data modeling, applying valid analytical 
techniques to given business problems and ensuring 
overall analytical objectives are met 

• Show the analyst presentation 

V^Share the code ^ 
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4 Core Deliverables to Meet Most Stakeholder Needsc*? 

1. Presentation for Project Sponsors 

"Big picture" takeaways for executive level stakeholders 

Determine key messages to aid their decision-making process 

Focus on clean, easy visuals for the presenter to explain and for the 
viewer to grasp 

2. Presentation for Analysts 

Business process changes 

• Reporting changes 

• Fellow Data Scientists will want the details and are comfortable with 
technical graphs (such as ROC curves, density plots, histograms) 

3. Code for technical people 

4. Technical specs of implementing the code 
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Analyst Wish List for a Successful Analytics 
Project 

Data & Workspaces 

• Access to all the data, including aggregated OLAP data, Bl tools, raw data, structured 
and various states of unstructured data as needed 

• Up-to-date data dictionary to describe the data 

• Area for staging and production data sets 

• Ability to move data back and forth between workspaces and staging areas 

• Analytic sandbox with strong compute power to experiment and play with the data 

Tools 

• Statistical/mathematical/visual software of choice for a given situation and problem set, 
such as SAS, Matlab, R, java tools, Tableau, Spotfire 

• Collaboration: an online platform or environment for collaboration and communicating 
with team members 

• Tool or place to log errors with systems, environments or data sets 
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Check Your Knowledge 


In which phase would you expect to invest most of your project time and 
why? Where would expect to spend the least time? 



Your Thoughts? 


• What are the benefits of doing a pilot program before a full scale rollout of a 
new analytical methodology? Discuss this in the context of the mini case 
study. 


• What kinds of tools would be used in the following phases, and for which 
kinds of use scenarios? 

► Phase 2: Data Preparation 

► Phase 4: Model Execution 

• Now that you have completed the analytical project at Yoyodyne, you have an 
opportunity to repurpose this approach for an online eCommerce company. 
What phases of the lifecycle do you need to focus on to identify ways to do 
this? 
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Module 2: Summary 


Key points covered in this module: 

• The Data Analytics Lifecycle was applied to a case study 
scenario 

• A business problem was framed as an analytics problem 

• The four main deliverables in an analytics project were 
identified 
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